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EXPERIMENTAL DESIGN FOR COMPLEX SYSTEMS 

William D. Heavlin 

5 BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates generally to the manufacture of high performance 
semiconductor devices. More specifically, this invention relates to a systematic approach 
to an experimental design for large, complex systems. Even more specifically, this 
10 invention relates to a method for systematically designing experiments when prior 

knowledge of the many factor and multiple responses is expressed as a network of cause- 
effect relationships. 

2. Discussion of the Related Art 

The design of a new semiconductor device and the process for manufacturing the 
15 new semiconductor device has three phases: the development phase during which 

processing alternatives are still under evaluation and the nominal process targets continue 
to be tuned; the pre-production phase during which the process targets are more-or-less 
set, processing experience is acquired, and appropriate tolerance windows are determined; 
and the production phase during which both the process target and tolerance windows are 
20 more-or-less fixed, and the full resources of the manufacturing line are committed in 

volume. The present invention focuses on the pre-production phase during which process 
targets are substantially set, but process experience is to be accumulated, and during which 
appropriate tolerance windows need to be determined. 

The pre-production phase plays an essential role in managing the manufacturing 
25 risk factor, providing a time period for determining problematic and challenging process 
steps, for investigating the range over which product can be manufactured successfully, 
and for reliability stress testing. The scale of current semiconductor manufacturing 
processes magnifies all of the issues, for example, contemporary semiconductor processes 
have 300-400 value added steps, any of which is a source of poor quality and/or reliability. 
30 A cost of a single test batch can exceed one quarter million dollars. A delay in market 
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entry equal to one cycle of learning (the production time required to make one batch) 
approaches two orders of magnitude more. 

Competitive pressures have provided strong incentives to keep pre-production 
costs to an effective minimum. In the statistics literatare, it is vv'ell recognized that 
5 appropriately designed experiments more fully characterize processes than, for example, 
multiple repetitions of the nominal process. The pre-production assessment of a new 
semiconductor manufacturing process typically involves many factors and can be from 30 
- 50 and sometimes more, multiple blocks, typically from 5-15 blocks, and several 
responses, typically from 3-8 responses. One practical constraint is for each 
10 experimental block to be self-contained, in the sense that each block supports an analysis 
without necessarily requiring results from other blocks. A complementary goal has the 
entire ensemble of experimental blocks covering the process space well. Subject matter 
expertise is both available and desirable and can be organized as a network of likely cause- 
effect relationships. 

15 The present invention thus presents a systematic approach to the pre-production 

problem, including objectives, constraints, overarching model, blocking structures, split 
and skew factors and self-containing blocks. 

SUMMARY OF THE INVENTION 

According to the present invention, the foregoing and other objects and 
20 advantages are achieved a systematic approach to forming experimental designs for large, 
complex systems after an idea for a product is formed. In accordance with a first aspect of 
the invention, critical variables for the product are determined by experts in the field, a 
design matrix Uk is defined, a base design matrix X is generated, Y(P) =(I-B(B^B)"'B^)[X 
P)//U] A & Wynn' s criterion is defined, where P is a permutation matrix, I is an identity 
25 matrix, B is a blocking matrix, B^ is a transposed matrix of B and A is a matrix composed 
of causal map-base coefficients and wherein a design matrix Uk is created. The index k 
•^k+1 is set and an algorithm to choose the best of random column permutation matrices P 
and an algorithm to choose the best column permutation matrix P that is near a previous 
solution and settin Uk<-[X P'' with rows from Ut.i appended]. 

30 In accordance with another aspect of the invention, it determined whether the 

design Ut is large enough and if not the process described above is repeated until the 
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design Uk is large enough. If it is determined that the design Uk is large enough protype 
products are manufactured, model responses are determined from the prototype wafers and 
determining whether the model responses are adequate. 

In another aspect of the invention, if the model responses are adequate, tolerances 
5 for the product are assessed and proposed. If the tolerances assessed and proposed are 
manufacturable, the product is passed to full-scale production. 

In another aspect of the invention, if the model responses are not adequate, the 
experimental design is repeated to create further Uk. This procedure is repeated until a 
design Uk is achieved that indicates that the model is adequate. 

10 In another aspect of the invention, if the tolerances assessed and proposed are not 

manufacturable, the design experiment is repeated until a design Uk is achieved that 
provides a manufacturable product. 

The described invention thus provides a method for a systematic approach to 
forming experimental designs for large, complex systems after an idea for a product is 
15 formed. 

The present invention is better understood upon consideration of the detailed 
description below, in conjunction with the accompanying drawings. As will become 
readily apparent to those skilled in the art from the following description, there is shown 
and described an embodiment of this invention simply by way of illustration of the best 
20 mode to carry out the invention. As will be realized, the invention is capable of other 
embodiments and its several details are capable of modifications in various obvious 
aspects, all without departing from the scope of the invention. Accordingly, the drawings 
and detailed description will be regarded as illustrative in nature and not as restrictive. 

BRIEF DESCRIPTION OF THE DRAWINGS 

25 The novel features believed characteristic of the invention are set forth in the 

appended claims. The invention itself, however, as well as a preferred mode of use, and 
further objects and advantages thereof, will best be understood by reference to the 
following detailed description of an illustrative embodiment when read in conjunction 
with the accompanying drawings, wherein: 
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Figure 1 is a flow diagram showing the steps for the development of a 
semiconductor device from the "Idea for a Product" to the "Production" of the 
semiconductor product; 

Figure 2 is flow diagram showing the steps for the pre-production phase of the 
5 development of a semiconductor product; 

Figure 3 is a diagram of a Causal-Effect Diagram; 

Figures 3A - 3G are sub-diagrams associated with the Causal - Effect Diagram 
shown in Figure 3; and 

Figure 4 is a causal map derived from information contained in the Causal-Effect 
10 Diagram shown in Figure 3. 

DETAILED DESCRIPTION 

Reference is now made in detail to a specific embodiment or specific 
embodiments of the present invention that illustrate the best mode or modes presently 
contemplated by the inventors for practicing the invention. 

15 Figure 1 is a flow diagram 100 showing the steps for the production of a 

semiconductor device from the initial "idea" for the semiconductor device through the 
production of the semiconductor device. The first step is the generation of an "Idea for a 
Product" Figure 1, Step A, 102. The next step is the "Initial/Further Development of 
Idea" that comprehends gathering data associated with the desired product, Figure 1, Step 

20 B, 104. The next step is to "Design/Refine Experiment" Figure 1, Step C, 106 and as 

indicated by the arrow 108 the flow goes to Figure 2 Step A. Figure 2 is a flow diagram 
200 showing the steps for the pre-production phase of the present invention and will be 
discussed below. After the pre-production phase shown in Figure 2 is completed the flow 
returns to the flow diagram 100 as shown by arrow 110. Prototype wafers manufactured 

25 using designed experimental values are evaluated at 112. The responses from the 

prototype wafers are empirically measured and mathematically modeled at 114. It is 
determined at 116 whether the response models are adequate. If the response models are 
not adequate, the flow returns to Figure 2, Step I as indicated by arrow 118. If the models 
are adequate, the next step at 120 is to assess and propose tolerances. It is determined at 

30 122 if the proposed tolerances can be manufactured. If the proposed tolerances can be 
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manufactured, the designed wafers are sent into production at 124. If the proposed 
tolerances cannot be manufactured, the flow is returned to Step B as indicated by the 
arrow 126. 

Figure 2 is a flow diagram 200 showing the steps of the pre-production phase of 
5 the present invention. Arrow 202 indicates the flow from Step C, Figure 1. Referring to 
Figure 2, Step A, the critical variables for the product and for the manufacturing of the 
product are determined at 204. The critical variables are determined by experts in the 
relevant art, in this case, the semiconductor manufacturing art. As an example, the experts 
determine that the following factors would be the critical variables for the proposed 



10 


semiconductor product: 






1. Speed 


2. N2P 




B.Vth 


4. Gate Oxide 




5. Gate Resistance 


6. R s/d 




7. Leff 


8.LDC 


15 


9.LDD 


10. S/D Rs (Source/Drain resistance) 




ll.PolyDelW 


12. lox 




13. RTA sd (rapid thermal anneal s/d) 


14. DopLoss 




15. ScreenOx 


16. spacer 




17. spacer Thk 


18. spacer Ent 


20 


19. PolyThk 


20. G Dopant (gate dopant) 




21. s'cide Rs (silicide resistance 


22. Act Length 




23. CD control 


24. SiON Strip (silicon oxynitride strip) 




25. G stp 


26. LI bot CD 




27. xface s/d Rc 


28. Co QT 


25 


29. s'cide pen 


30. G N2.I2 




31. RpdepThk 


32. LI DI CD 




33. spacer c/e 


34. s'cide RTA (silicide rapid thermal anneal) 




35.CO Thk 


36. XterW (transistor width) 




37. VNWPI 


38. GateOx QT 


30 


39. G R'cle (Gate reticle) 


40. SiON Dep (silicon oxynitride deposition) 




41.GMaskQT 


42. Trim Time 




43. 12 damage 


44. UDOXthk 




45. nitrideDep (nitride deposition) 


46. polishThk (polish thickness) 




47. LI etch recipe (local interconnect 


48. LI Thk (local interconnect thickness) 


35 


etch recipe 






49. LI align (local interconnect alignment) 




50.LIo/e 


51.BMDPCII 




52. BMD DepThk 


53. RPE o/e 



Generating such lists of responses and factors is a common part of experimental 
40 design practice. At one end of the experimental spectrum are small experiments and short 
lists of expecially important variables (responses and factors). Because there weren't 
efficient experimental methods to incorporate larger numbers of variables, complex 
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systems with larger numbers of variables could not be efficiently designed. The present 
invention provides a method of efficiently designing larger more complex lists of 
variables. The ability of efficiently designing experimental designs for the larger more 
complex lists of variables is the major value of the present invention. 

5 Using the above-listed critical variables, a classical causal network diagram is 

created, Figure 2 Step B, 204. The terms "cause-effect diagrams," "causal networks," and 
"causal maps" are used in various ways in the relevant art. A cause-effect (or CE) diagram 
consists of a single response (at the head of a central backbone), major factor groups (as 
spines branching from the backbone), and lower level factors (off each spine), and perhaps 

10 branching off from other low level factors. In modem terms, CE diagrams render causal 
relationships as a strict hierarchy, with the response as the root node, factor groups as the 
primary branches and other branches expanding therefrom. Causal networks are 
generalizations of CE diagrams, with three extensions: (1) the number of responses can be 
more than one, (2) responses can point causally to other responses, and (3) each factor is 

15 represented as one and only one node, even though it may contribute to various other 
responses and/or to higher-level factors. With newly introduced semiconductor 
manufacturing processes, transistor characterizations have about F=50 factors (F denotes 
the number of factors of interest) and Fi is about 8 (Fj is the number of factors feasible to 
vary in any single block), the corresponding causal networks are complicated. For this 

20 reason, causal networks are transformed into causal maps. 

The transformation of causal networks into causal maps involves the following: (i) 
the distance between any pair of nodes of a causal network is the minimum number of 
links of the path connecting them (this is shown below in the intemode link-count distance 
matrix); (ii) the corresponding matrix giving the distances between any pair of nodes is the 
25 natural input data structure for multidimensional scaling; and (iii) using a 

multidimensional scaling algorithm, such as XGvis (Buja et al. 1998) wherein the distance 
matrix is transformed into node coordinates in D = 2 dimensions. 

Causal maps that are constructed in this way have extra information that causal 
networks do not: (1) a factor closer to a response node plausibly has a stronger effect; (2) 
30 two factors close together likely share an interaction; (3) responses sharing many factors 
cluster; and (4) higher-level factors tend toward the map center. 



6 



PATENT 



Attorney Docket No. F0019 



The causal network diagram created using the critical variables is shown in 
Figures 3 & 3A - 3G. Establishing which critical variables affect other factors creates the 
causal-effect network. A causal-effect is in the form "cause => effect." Some of the 
critical variables are established as "higher-level responses" and are shown enclosed in 

5 boxes. Responses shown in Figure 3 are "Leff ' at 302, "R s/d" at 304 and "Vth(long)" at 
306. The sub-diagrams shown in Figures 3A - 3G show some of the critical variables 
shown in Figure 3 with additional critical variables "pointing" to them. For example, a 
critical factor "poly delta W" shown at 308, Figure 3 is shown in Figure 3A with three 
arrows from critical variables pointing to it. It should be noted that the critical factor 

10 "poly delta W" is therefore a response because other critical variables affect it (the number 
of arrows that are directed toward it), for example, the critical factor "poly delta W" as 
shown in Figure 3A has 3 arrows directed towards it directly and 5 arrows directed to 
another critical factor "CD control" 310 and an arrow from the critical factor "CD control" 
310 is directed to the critical factor "poly delta W." Some of the critical variables that are 

15 identified as responses, such as the response "poly delta W" are termed "intermediate 
responses." 

The next step is to create an Intemode Link-Count Distance Matrix, Figure 2, 
Step C, 208. Table 1 is an "intemode link-count distance matrix." The values in the 
matrix are derived by counting the least number of links from any one node of a factor or 

20 response any to any other factor or response in a causal map as shown in Figure 4. For 

example, the intemode link-count distance "1" from the factor "speed" to the factor "N2P" 
is obtained by counting the link from the factor "N2P" to the factor "speed." Similarly, 
the intemode link-count distance "2" from the factor "speed" to the factor "Vth" is 
obtained by counting the link from the factor "Vth" to the factor "N2P" and the link from 

25 the factor "N2P" to the factor "speed." The other matrix elements are derived in the same 
manner. 



INTERNODE LINK-COUNT DISTANCE MATRIX 



TABLE 1 



1 Speed 2N2P 3Vth 4 Gate 5 Gate ••• 51 BMD BMD RPE 



30 



Factors (F) 



Ox R PCII DepThk o/e 



35 



5 Gate R 
6Rs/d 



1 Speed 
2N2P 
3 Vth 



4 Gate Ox 



0 1 2 2 1 4 4 4 

1 0 1 1 2 3 3 3 

2 1 0 1 3 4 4 4 
2 1 1 0 3 4 4 4 

1 2 3 3 0 4 4 4 

2 1 2 2 3 2 2 2 
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7Leff 
8LDC 
9LDD 

10 S/D Rs 

11 PolyDelW 
I2I0X 

13 RTAsd 

14 DopLoss 

15 ScreenOx 

16 spacer 

17 spacer Thk 

18 spacer Ent 

19 PolyThk 

20 G Dopant 

21 s'cide Rs 

22 Act Length 

23 CD control 

24 SiON strip 

25 G stp 

26 LI bot CD 

27 xface s/d Rc 

28 Co QT 

29 s'cide pen 

30 G N2.I2 

31 RpdepThk 

32 LI DI CD 

33 spacer c/e 

34 s'cide RTA 

35 Co Thk 

36 XterW 

37 VNWPI 

38 GateOx QT 

39 G R'cle 
40SiONDep 

41 GMaskQT 

42 TrimTime 

43 12 damage 

44 UDOXthk 

45 nitrideDep 

46 polishThk 

47 LI etch recipe 

48 LI Thk 

49 LI align 

50 LI o/e 

51 BMDPCII 

52 BMD DepThk 

53 RPE o/e 
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When the Intemode Link-Count Distance Matrix is determined, the next step is to 
50 apply a multidimensional scaling algorithm to create a D-dimensional (D typically 2 or 3) 
set of node coordinates called a causal map. Especially when D = 2, one can plot the 
nodes as points on rectangular graph paper, and so both the coordinates themselves and the 
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sesulting graph 400, Figure 4 are called causal maps. One example of a multidimensional 
scaling algorithm is XGvis. Its application to visualizing networks is known and is 
conventional practice. 

The next step is to create a Causal Map, Figure 2, Step D, 210. Figure 4 shows 
the Causal Map 400 derived from information contained in the causal network shown in 
Figures 3 & 3A - 3G and from information contained in the Intemode Link-Count 
Distance Matrix, Table 2. 

Once the Causal Map is determined, the next step is to Identify Response Nodes, 
Figure 2, Step E, 212. An inspection of the Causal Map 400, Figure 4 shows that the key 
responses move towards the center and are R s/d, n and p, at 402, Vth, n and p, at 404 and 
Leif, n and p, at 406. It is noted that part of the selection of key responses is the exercise of 
engineering judgment and additional selections or alternate selections could be made. 

After the values in Table 1 are determined and after the Key Responses are 
determined the next step is to calculate the Map-Based Coefficients ay. Figure 2, Step F, 
214. Table 2 shows the Matrix A (columns Va.n to Leff,p of Table 2 make up Matrix A) 
with values derived from information contained in Table 1 & Figure 2, Step F, at 214. 

The following example shows how the values in Table 2 are calculated. Suppose 
the causal network has factors f 1, f2, and f3 all pointing to response rO having values 
determined from a similar Intemode Link-Count Distance Matrix as shown in Table 1. 
The portion of the intemode link-count distance matrix is: 

rO fl f2 f3 



rO 

fl 
£2 
f3 



0 111 

10 2 2 

12 0 2 

12 2 0 



The causal map coordinates in 2 dimensions (D - 2) are approximately: 





diml 


dim2 


rO 


~ 0 


0 ~ 


fl 


1 


0 


f2 


-0.5 


0.866 


f3 


-0.5 


-0.866 



Note: rO is in the middle and f l,f2, and f3 form an equilateral triangle around rO. 
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The distance between fi and fj is square root of 3 (not quite 2), but the distance between rO 
and fi is 1. The multidimensional scaling would try to balance this, and so the causal map 
in D = 2 might be approximately 1.3 times the above, as shown below: 



5 





diml 


dim2 


rO 


0 


0 


fl 


1.3 


0 


f2 


-0.65 


1.126 


f3 


-0.65 


-1.126 



10 

Note: The distances between fi and fj are 2.252 and the distance between rO and fjis 1.3. 
The coefficient is determined as follows: 

(rO, f.) = e(«*distance(rO,fi)'^2)^ g(-a*1.3*1.3) ^ ^-1.69^ ^^^^ ^^-^^ f, y ^ q.ISS. 

15 The matrix would then be: 

rO 

fl 0.185 
f2 -0.185* 
f3 0.185 

20 *The negative sign for factor f2 is applied by experience and indicates that an increase in 
the value of factor f2 produces a decrease in the response rO. 

TABLE 2 
Map Based Coefficients (Matrix A) 

25 





knob 


Vth,n 


R s/d,n 


Leff.n 


Vth,p 


R s/d,p 


Leff,p 




1 XterW 




-0.107888 






-0.107888 






2 12 damage 




0.025962 












3VNI 


-0.221786 












30 


4 VPI 








0.221786 








5 GateOx QT 


0.137194 




-0.137194 










6 Gate Ox 


0.246187 




-0.246187 










7 PolyThk 


0.116432 


0.119731 




-0.116432 


0.119731 






8 G N2.I2 


-0.052234 




-0.104468 








35 


9 SiOn Dep 






0.065866 






0.065866 




10 G Mask QT 






0.060969 






0.060969 




11 Gstp 






0.158818 






0.158818 




12 SiON strip 






-0.064624 






-0.064624 




13 LDC n 


-0.179057 




-0.196067 








40 


14 LDC p 








0179057 




-0.196067 




15 LDD n 




-0.227165 


-0.166824 










16 LDD p 










-0.227165 


-0.166824 




17 UDOXl 




0.082092 






0.082092 






18Iox 




0.025134 






0.025134 




45 


19 spacer Thk 




0.108862 


0.109174 




0.108862 


0.109174 




20 spacer o/e 




-0.152447 


-0.108867 




-0.152447 


-0.108867 




21 spacEtchEnt 
















22 UDOX2 




0.026926 






0.026926 






23 RpdepThk 




-0.10924 






-0.10924 




50 


24 RTAsd 


-0.202057 


-0.113617 


-0.069277 


0.202057 


-0.113617 


-0.069277 




25 RPE o/e 




-0.107437 






-0.107437 
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26 Co QT 


0.109251 


0.109251 


27 Co Thk 


-0.113116 


-0.113116 


28 s'cideRTAl 


-0.116867 


-0.116867 


29 s'cide RTA2 


-0.116867 


-0.116867 


30 LI Thk 


-0.096417 


-0.096417 


31 polish Thk 


0.09219 


0.09219 


32 LI DICD 


-0.87249 


-0.087249 


33 LI alignX 


0.078742 


0.078742 


34 LI alignY 


0.078742 


0.078742 


35 LI o/e 


0.106432 


0.106432 


36 BMDDepTh 


0.101266 


0.101266 


37 BMD PCII 


0.101964 


0.101964 



Note: Blanks (or zeros) indicate that a particular critical factor does not affect the particular 



response, i.e., there is no "cause-effect." 

15 



After the map-based coefficients (Matrix A) are detemnined, Figure 2, Step F, 
214, k is set to 0 and the matrix Uk ==(null, zero-row matrix). Figure 2, Step G, 216. 



An initial base design matrix, X, is established by statistician experts in the field, 
Figure 2, Step H, 218. The base design matrix X shows in a generic way the form of the 
20 design; it is generic in the sense that particular factors are not yet assigned to particular X- 
columns. 



Table 3 show two design alternatives, one design alternative is a "split-plot only 
design" and the other is an "interblock" design. The split-plot design varies factors only 
within the lot (block). The interblock design varies factors both from lot to lot and within 
25 lot. The former set of factors are conventionally termed skew factors, the latter are termed 
split factors. In each of the two design alternatives Lg and L'g are matrices as follows: 
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0000 
0000 
0000 
0000 
0000 
0000 
0000 
0000 

0000 
0000 
0000 
0000 
0000 
0000 
0000 
0000 

0000 
0000 
0000 
0000 
0000 
0000 
0000 



split-plot design 

0000 0000 0000 

0000 0000 0000 

0000 0000 0000 

0000 0000 0000 

0000 0000 0000 

0000 0000 0000 

0000 0000 0000 

0000 0000 0000 

0000 0000 

0000 0000 

0000 0000 

0000 0000 

0000 0000 

0000 0000 

0000 0000 

0000 0000 



0000 
0000 
0000 
0000 
0000 
0000 
0000 
0000 

0000 
0000 
0000 
0000 
0000 
0000 
0000 



0000 
0000 
0000 
[L's] 0 0 0 0 
0000 
0000 
0000 
0000 

0000 
0000 
0000 

00 0 0 [L'g] 
0000 
0000 
0000 



interblock design 



- + 0 0 0 + 

- + 0 0 0 + 

- + 0 0 0 + 

- + 0 0 0 + 



45 P is a permutation matrix and the matrix product XP constitutes a rearrangement 

of the columns X. The matrix A is a matrix of coefficients linking (linearly) the full 37 
dimensional space to the 6 dimensional intermediate variable space, (37 factors (first 
column) and 6 responses (column headings) Table 2). The established initial design 
matrix X does not associate particular factors with particular columns of X, but it does 

50 describe the overall patterns of the experiment, that is, how many split factors per block, 
how many skew factors per block, how many runs (wafers) per block. A block is a set of 
experimental runs (wafers) processed together (in semiconductor processing; a lot). Split 
factors are factors that take on at least two values within a given lot (block). Skew factors 
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are factors that take on different values from nominal (0), but are constant within the 
block. 

For any particular assignment of X-columns to factors one can compute a score. 
This score is related to a prediction of how spread out the eventual results (responses) 
5 measured on the wafers (runs, rows of X) are predicted to be. The better designs will have 
better (higher) scores. This number is calculated by assigning particular colunms of X to 
particular factors, one-to-one, with no duplicate assignments and no factors left out. 

A list-to-list assignment, with a score about which assignments are worse or 
better, is known as "the traveling salesman problem." In the conventional description of 

10 the traveling salesman problem, a salesman needs to visit a list of cities once each and 
wants to minimize the driving time. In that context, a salesman has one list — of cites — 
and another list, the number 1, 2, 3, 4, and needs to assign each number to each city. 
Assigning 1 to city B means visit that city first, 2 to city D means visit that city second, 
and so on. Such an algorithm gives an X-column-to-factor assignment with the biggest 

15 score of any assignment considered. The R step/E step algorithm discussed below is one 
particular traveling-salesman-solving algorithm. 

Conceptually, if an assignment is made of X-columns and factors at random and if 
another random assignment is made, there is a 50% chance that a higher score would be 
obtained. If a third random assignment is made, there is a chance of 33% of achieving a 

20 higher score than the previous two assignments, etc. As can be appreciated, random 
guessing (R step) bogs down and offers no improvement after numerous tries. What is 
done is pick the best so far and see if, swapping just one pair of factors' X-columns 
achieves a higher score. Doing this one pair at a time for all pairs of factors is the done by 
the E algorithm discussed below and is repeated until all pairs have been examined 

25 without an improvement. 

The optimal design algorithm including the algorithm R(k) and the algorithm E(k) 
are run with k = k + 1. Figure 2, Step 1, 220. Y(P) = (I-B(B^B)-^B^)[(X P)//U]A & 
Wynn's criterion is run. Note that the term (I-B(B'^B)'*B'^) is a projection matrix that 
acts to filter out effects correlated with B, leaving only effects not correlated with B, that 
30 is, it serves as a blocking function. B is a matrix of dummy variables representmg the 

blocks. After Y(P) is defined, the algorithms R(k) and E(k) are run. R(k) is an algorithm 
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to choose the best of random column permutation matrices P. E(k) is an algorithm is to 
choose the best column permutation matrix P that is "near" a previous solution. (On the 
first iteration of algorithm E, the previous solution comes from algorithm R; thereafter, the 
previous solution comes from the last application of algorithm E.) Note that A//B means: 
5 "append the rows of B to the rows of A, with the rows of A on top. 

Wynn's criterion: If {yi: i = l...n} denotes a set of k-dimensional points 
comprising a possible experimental design, and the nxn matrix C is defined with typical 
element c(i,j) = exp(-llyi-yjll^). Wynn's criterion is that a design {yi} is better when detC. 
is larger ("det" denotes the matrix determinant). If C is interpreted as a correlation matrix, 
10 det(C) represents the generalized variance, which Wynn's criterion maximizes. This is 
achieved by moving the points {yj: i=l . . .n} far from one another. 

C, such that C(i,j) = exp{-llyi-yjlP). Distances among points {yi} are transformed 
into "correlations" as discussed above. The points {yj are the rows of matrix Y(P). 

Algorithm R(k): 

15 Let X' denote the best current design, with criterion value c', which is a scalar and 

initially c' = 

Loop in r=l to Hr 

Randomly rearrange columns of base design matrix X, resulting in Xr 
Form Wr by adding to matrix Xr the rows of Uk-i 

20 Yrl = WrA 

Y,2 = [I-B(B^B) 'B^'lYri 
Cr= detC(Y,i) x detC(Yr2) 

if it is determined at 222, Figure 2, that c, > c' then X' = Xr and c'=Cr 
end Loop r. 

25 The function of algorithm R is to choose the best of n^ random column 

permutation matrices P. 
Algorithm E(k): 

Let X' denote the best current design, with criterion value c', the scalar from 
algorithm R. 
30 Label E: NoImprovement=true 

X" = X' 
c" = c' 

Loop in i=l to n-1 
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Loop in j =i+l to n 

Form matrix by swapping columns i,j of X' 
Form Wij by adding to matrix Xy the rows of Uti * 

Yel=WyA 

5 Ye2 = [I-B(B''B)^B'']Yei 

Cij = detC(Yei) X detC(Ye2) 

K Cij > c", then X" = Xy and c" = Cy, Nolmprovement =false 
end Loopj 
end Loop i 

10 if Nolmprovement then STOP else go to Label E. 

Note 1 : If a factor with a strong factor is split . & Yr2 are both more dispersed, 
hence larger criterion. If some factor is skewed instead, Yri is dispersed, but not Yr2. In 
this way this criterion gives double points for splitting strong factors. 

* Note 2: It is conventional practice for statisticians to term vertical elements as 
15 "columns" and the horizontal elements as "rows." 

Tables 4 - 6 are examples of designs and solutions for particular 18-wafer lots 
and were extracted from a larger solution of 6-8 lots. Each design and solution, for 
example, the design and solution in Table 4 is a design Uk indicated at 224, Figure 2, 
20 Step J. 

After the optimal design algoritm is run Step I, Figure 2, 220 is run it is 
determined at 222 if the design Uk is large enough. If it is determined at 220 that there the 
design Uk is not large enough the flow returns to Step I and the optimal design algorith is 
repeated until it is determined at 222 that the design Uk is large enough. When this occurs 
25 the flow goes to Step J and the design experiment Uk is complete and the flow returns to 
Figure 1, Step D as indicated by arrow 226. 

When the flow returns to Step D, Figure 1, prototype wafers using the designed 
experiment are manufactured. As discussed above. Tables 4-6 each show 1 lot (18 
wafers) of a solution and design that could be 6-8 wafers. The manufactured prototype 
30 wafers are tested and model responses are measured at 114, Figure 1, Step E. 

It is determined at 116 whether the Model Responses are adequate. If the model 
responses are not adequate, the flow returns to Step I, Figure 2 as indicated by arrow 118. 
Step I, Figure 2 is the step of running the Optimal design algorithm and Steps I, Figure 2 
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through Step E, Figure 1 are repeated until it is determined at 116, Figure 1 that the 
model is adequate. 

After the model is determined to be adequate at 116, the tolerances are 
assessed/proposed at Step F, Figure 1, 120. Whether the proposed tolerances are 
5 manufacturable is determined at 122, Figure 1 and if the proposed tolerances are not 
manufacturable, the flow returns to Step B as indicated by arrow 126. The development 
of the idea then begins anew at Step B. If it is determined at 122, Figure 1 that the 
proposed tolerances are manufacturable, the best solution of the design is sent to 
production at Step G, Figure 1, 124. 

10 Table 4 is a lot (block) of 18 wafers and the total solution could be 6 - 8 lots. 

After a total number of lots is completed, the wafers are manufactured and tested to 
validate the experiment and to choose the best set of factors to use for full scale 
production. 

Table 4 is an example Split Sheet for one of 6 lots and is a part of a matrix [XP] 
15 and shows the results of running the optimization algorithm. A split sheet includes 

instructions for processing the wafers of one particular lot (one block). Format is (XP)''^: 
that is, the columns are wafers in a split sheet, and the rows are factors. (Conventional 
experimental design notation has a reverse convention: the rows (the vertical elements) are 
wafers and the columns (the horizontal elements) are factors.) 

20 

TABLE 4 

wafer#-> 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 



Factor 

1 XterW 0000000000 000 0 0 0 0 0 

25 2 12 damage o ------------ - - - - 0<=** 

=>*3 VNI Q. + +.. + + . + .-++. - + 0 

4 VP! 0 - - 0<= 

5 GateOxQT 0 - - - ------ - - - - - - - 0<= 

6 GateOx 0 - - - ------ - - - - - - - 0<= 

30 7 PolyThk o - - - ------ - - - - - - - 0<= 

=>8GN2I2 0 --++-- + + - - + + - - + + 0 

9 SiOn Dep 000000000000000 000 

10 G Mask QT 00 00 000000 0 000 0 00 0 
llGstp 000000000000000 000 

35 12 SiOn strip 0 ------------- - - - 0<= 

=> 13LDC n 0- - + + -H+0 

14LDCp 0 ------------- - - - 0<= 

15Iox 00000000000 0000 000 

16LDDn 0- + - + -+ --t---i- - + - -i- -+0 

40 17LDDp 0 - - - - - - - - - - - - - - - - 0<= 
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18 UDOXl 


0 0 0 


0 


0 


00 0 


0 


0 0 0 0 


0 


0 


0 


0 


0 




19 spacer Thk 


0 0 0 


0 


0 


00 0 


0 


0 0 0 0 


0 


0 


0 


0 


0 




20 spacer o/e 


0 - 
























0 




=> 21 spacerEtchEnt 0 - 




+ 




+ - - 


+ 






+ 






+ 


0 


5 


99 T Trin"V9 


0 0 




0 


0 


0 0 0 


0 


0 0 0 




0 


0 


0 


0 


0 




23 RpdepThk 




Q 


0 


0 


0 0 0 


0 


0 0 0 


0 


0 


0 


0 


0 


0 




=> 24 RTAsd 


0- 
























0 




25 RPE o/e 


00 


0 


0 


0 


00 0 


0 


n "n o 




0 


0 


0 


0 


0 




26 Co QT 


00 


0 


0 


0 


00 0 


0 


0 0 0 




0 


0 


0 


0 


0 


10 


27 Co Thk 


00 


0 


0 


0 


00 0 


0 


0 0 0 


0 


0 


0 


0 


0 


0 




28 s'cide RTAl 


0- 
























0<= 




29 s'cide RTA2 


0- 
























0<= 




30 LI Thk 


00 


0 


0 0 


0 0 0 


0 


0 0 0 


0 


0 


0 


0 


0 


0 




31 polishThk 


00 


0 


0 0 


0 0 0 


0 


0 0 0 


0 


0 


0 


0 


0 


0 


15 


32 LI DICD 


0 - 
























0<= 




33 LI alignX 


00 


0 


0 


0 


0 0 0 


0 


0 0 0 


0 


0 


0 


0 


0 


0 




34 LI alignY 


00 


0 


0 


0 


0 0 0 


0 


0 0 0 


0 


0 


0 


0 


0 


0 




35 LI o/e 


00 


0 0 


0 


0 0 0 


0 


0 0 0 


0 


0 


0 


0 


0 


0 




36 BMD DepThkO 0 


0 0 


0 


0 0 0 


0 


0 0 0 


0 


0 


0 


0 


0 


0 


20 


37 BMD PCII 


00 


0 0 


0 


0 0 0 


0 


0 0 0 


0 


0 


0 


0 


0 


0 



* The left-side arrows indicate, "split factors." 



** The right-side arrows mean that the factors varied in this lot for lot-to-lot experiment 
25 (skew factors). 

Note: In Tables 4-6, the "0" means that the factor has not been increased or decreased 
from the nominal value, that the "-" means that the factor has been decreased and that the 
"+" means that the factor has been increased. 



Table 5 is a Split Lot with No Skewed Factors 



TABLE 5 





wafer # 


1 


2 3 4 


5 


6 


7 


8 


9 10 


11 


12 


13 


14 


15 


16 


17 


18 


35 


Factor 


































1 XterW 


0 


0 0 0 


0 


0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 




2 12 damage 


0 


0 0 0 


0 


0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 




3 VNI 


0 


0 0 0 


0 


0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 




4 VPI 


0 


-1 -1 -1 


-1 


-1 


-1 


-1 


-1 1 


1 


1 


1 


1 


1 


1 


1 


0 


40 


5 GateOx 


0 


0 0 0 


0 


0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 




6 GateOx 


0 


0 0 0 


0 


0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 




7 PolyThk 


0 


0 0 0 


0 


0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 




8 GN2I2 


0 


0 0 0 


0 


0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 




9 SiOnDep 


0 


0 0 0 


0 


0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


45 


10 G Mask QT 


0 


0 0 0 


0 


0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 




11 Gstp 


0 


0 0 0 


0 


0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 




12 SiOn strip 


0 


0 0 0 


0 


0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 




13 LDC n 


0 


-1 -1 -1 


-1 


1 


1 


1 


1 -1 


-1 


-1 


-1 


-1 


1 


1 


1 


0 




14 LDC p 


0 


-1 1 -1 


1 


1 


-1 


1 


-1 1 


-1 


1 


-1 


-1 


1 


-1 


1 


0 


50 


15I0X 


0 


0 0 0 


0 


0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 




16 LDD n 


0 


-1 1-1 


1 


-1 


1 


-1 


1 -1 


1 


-1 


1 


-1 


1 


-1 


1 


0 




17 LDD p 


0 


-1 -1 1 


1 


1 


1 


-1 


-1 1 


1 


-1 


-1 


-1 


-1 


1 


1 


0 




18 UDOXl 


0 


0 0 0 


0 


0 


0 0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 




19 spacer Thk 


0 


0 0 0 


0 


0 


0 0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 
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20 spacer o/e 


0 


-1 


-1 


1 


1 


-1 


-1 


1 


1 


-1 


-1 


1 


1 


-1 


-1 


1 


1 


0 


21 spacerEtchEntO 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


22 UDOX2 




0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


23 RpdepThk 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


24 RTAsd 


0 


-1 


1 


1 


-1 


-1 


1 


1 


-1 


1 


-1 


-I 


1 


1 


-1 


-1 


1 


0 


25 RPE o/e 




0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


26 Co QT 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


27 Co Thk 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


28 s'cide RTAl 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


29 s'cide RTA2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


30 LI Thk 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


31 polishThk 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


32 LI DICD 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


33 LI alignX 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


34 LI alignY 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


35LI o/e 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


36BMDDepThkO 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


37 BMD PCII 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 
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Table 6 is a Split Lot that includes skewed factors. 



TABLE 6 





wafer # 


1 






























25 


1 XterW 


0 


0 


0 0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




2 12 damage 


0 


0 


0 0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




3 VNI 


0 


0 


0 0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




4 VPI 


0 


-1 


-1-1 -1 


-1 


-1 


















-1 


0 




5 GateOxQT 


0 


-1 


-1 1 1 


-1 


-1 


















1 


0 


30 


6 GateOx 

7 PolyThk 

8 GN2I2 


0 
0 
0 


-1 
-1 
-1 


-1-1 -1 
-1 -1 -I 
-1 -1 -1 


-1 
-1 
1 


-1 
-1 
1 


















-1 
-1 
1 


0 
0 
0 




9 SiOnDep 


0 


0 


0 0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




lOGMaskQT 


0 


-1 


1-1 1 


-1 


1 


-1 1 


-1 


1 


-1 


1 


- 1 


1 


-1 


1 


0 


35 


11 G stp 


0 


0 


0 0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




12 SiOn strip 


0 


0 


0 0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




13LDC n 


0 


0 


0 0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




14 LDC p 


0 


0 


0 0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




ISIox 


0 


-1 


-1 -1 -1 


-1 


-1 


-1 -1 


-1 


-1 


-1 - 


1 


- 1 


-1 


-1 


-1 


0 


40 


16 LDD n 


0 


0 


0 0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




17 LDD p 


0 


0 


0 0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




18 UDOXl 


0 


-1 


-1 -1 -1 


-1 


-1 


-1 -1 


-1 


-1 


-1 - 


1 


- 1 


-1 


-1 


-1 


0 




19 spacer Thk 


0 


0 


0 0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




20 spacer o/e 


0 


-1 


-1 -1 -1 


-1 


-1 


-1 -1 


-1 


-1 


-1 - 


1 


- 1 


-1 


-1 


-1 


0 


45 


21 spacerEtchEntO 


-1 


-1 -1 -1 


-1 


-1 


-1 -1 


-1 


-1 


-1 - 


1 


- 1 


-1 


-1 


-1 


0 




22 UDOX2 


0 


-1 


-1 -1 -1 


-1 


-1 


-1 -1 


-1 


-1 


-1 - 


1 


- 1 


-1 


-1 


-1 


0 




23 RpdepThk 


0 


-1 


-1 -1 -1 


-1 


-1 


-1 -1 


-1 


-1 


-1 - 


1 


- 1 


-1 


-1 


-1 


0 




24 RTAsd 


0 


0 


0 0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




25 RPE o/e 


0 


0 


0 0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


50 


26 Co QT 


0 


-1 


-1 -1 -1 


-1 


-1 


-1 -1 


-1 


1 


1 


1 


1 


1 


1 


1 


0 




27 Co Thk 


0 


0 


0 0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




28 s'cide RTAl 


0 


-1 


-1 -1 -1 


-1 


-1 


-1 -1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


0 




29 s'cide RTA2 


0 


-1 


-1 -1 -1 


-1 


-1 


-1 -1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


0 




30 LI Thk 


0 


-1 


-1 -1 -1 


-1 


-1 


-1 -1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


-1 


0 


55 


31 polishThk 


0 


-1 


1 1-1 


1 


-1 


-1 1 


-1 


1 


1 


-1 


1 


-1 


-1 


1 


0 
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32 LI DICD 0 


0 


0 


0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


33 LI alignX 0 


0 


0 


0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


34 LI alignY 0 


0 


0 


0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


35 LI o/e 0 


-1 


1 


1 -1 


-1 


1 


1 -1 


1 


-1 


-1 


1 


1 


-1 


-1 


1 


0 


5 36BMDDepThkO 


0 


0 


0 0 


0 


0 


0 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 



37BMDPCII 0-1-1-1-1-1-1 -1-1-1 -1 -l-I -1-1 -1 -1 0 



In summary, the described invention thus provides a method for a systematic 
approach to forming experimental designs for large, complex systems after an idea for a 
10 product is formed. 

The foregoing description of the embodiment of the invention has been presented 
for purposes of illustration and description. It is not intended to be exhaustive or to limit 
the invention to the precise form disclosed. Obvious modifications or variations are 
possible in light of the above teachings. The embodiment was chosen and described to 

15 provide the best illustration of the principles of the invention and its practical application 
to thereby enable one of ordinary skill in the art to utilize the invention in various 
embodiments and with various modifications as are suited to the particular use 
contemplated. All such modifications and variations are within the scope of the invention 
as determined by the appended claims when interpreted in accordance with the breadth to 

20 which they are fairly, legally, and equitably entitled. 



19 



